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Abstract. In the first part of this paper, we consider 3x3x3 arrays with 
complex entries, and provide a complete self-contained proof of Kruskal's the- 
orem that the maximum rank is 5. In the second part, we provide a complete 
classification of the canonical forms of 3 X 3 X 3 arrays over F2; in particular, 
we obtain explicit examples of such arrays with rank 6. 



In 1989, Kruskal [(jj page 10] stated without proof that every 3x3x3 array with 
real entries has rank at most 5. A few years later, Rocci [7] circulated a simplified 
proof of this result, based on Kruskal's unpublished hand- written notes. The details 
of this argument appear never to have been published. In sections [2HH we consider 
3x3x3 arrays with complex entries, and provide a complete self-contained proof 
that the maximum rank is 5. 

In section [5] we consider this problem over the field F2 with two elements. A 
remarkable fact, first noted by von zur Gathen [9], is that in this case there exist 
3x3x3 arrays of rank 6. We provide a complete classification of the canonical 
forms of 3 x 3 x 3 arrays over F2; in particular, we obtain explicit examples of such 
arrays with rank 6. 

We use without reference many basic results on multidimensional arrays which 
can be found in de Silva and Lim [3] and Kolda and Bader [5]. 



1. Preliminaries on 3-dimensional arrays 
We consider a p x q x r array X with entries in an arbitrary field F of scalars: 



X 



[ %ijk \ i 



1 < i < p, 



l<j<q, 



1 < k < r. 



By a slice of X we mean any (2-dimensional) submatrix obtained by fixing one 
index. Fixing i gives a horizontal slice, fixing j gives a vertical slice, and fixing 
k gives a frontal slice. The matrix form of X is the p x qr matrix obtained by 
concatenating the frontal slices Xi, . . . , X r from left to right: 



X=[X X 



X r = 



Xlll 



Xpll 



Xlql 
Xpql 



X\lr 



Xplr 



X\q r 
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Given three column vectors, 
ai 



a 



G F« 



c = 



Cl 



G F r , 



their outer product a ® b ® c is the p x q x r array whose ijk entry is aibjCk- A 
simple tensor is an outer product of nonzero vectors. A fundamental problem is to 
represent the array X as a sum of simple tensors: 



X 



b (i) 



The rank of the array A is the smallest non-negative integer n for which this 
decomposition is possible. The rank is if and only if every entry of the array is 0; 
the rank is 1 if and only if the array is a simple tensor. 

The rank does not change if we permute the slices in each direction. Given 
permutations a G S p , (3 G S q , 7 G S r , we form another p x q x r array by 

((a,/3,7) ■ X).. k = x a{i)mj{k) . 

More generally, the rank does not change if we apply a change of basis in each 
direction. Given invertible matrices 

A=(a ili2 )€GL{p,¥), B = (b jlh )&GL(q,F), C = (c klk2 ) G GL(r,¥), 

we form another p x q x r array by 

((A,B,C).X) idik 



p q r 

y , y , ^ ] a ili2bjij2 C k 1 k 2 x i2j2k 2 
«2=1 32=1 k 2 = l 



The rank does not change if we permute the directions; however, this permutes the 
dimensions p, q, r and hence may give a different ordered triple (p, q, r). If we write 
the dimensions as p\ x p 2 X P3 with corresponding indices i±, 13 then applying a 
permutation S G S3 gives an array of size Ps(i) x Ps(2) x P$(3) defined by 

(6 ■ A)i 5(1) i a(2) i 5(3) =2:^^13. 

In the rest of this paper, we often use these rank-preserving transformations without 
further comment. 

2. TEN BERGE'S THEOREM ON 2 X 2 X 2 ARRAYS 

The results in this section are taken with minor changes from ten Berge [5]. 
However, for us the base field is C whereas for ten Berge it is R. We recall these 
results in detail since they are essential to the analysis of 3 x 3 x 3 arrays. For 
2x2x2 arrays, the rank decomposition takes the form 

n 

X = ^]a w ®b w ®c w , where a w , b w , c w G C 2 for 1 < i < n. 

i=l 

We express this decomposition in terms of three 2 x n matrices A,B,C: 

A=[aW ... a W], B = [b« •■■ bW], C = [c« ••■ c<»>] . 

Lemma 2.1. [Up. 632] T/ie rawfc 0/ a nonzero 2x2x2 array X is the least integer 
n > 1 such that the frontal slices X\, X 2 have the form X\ = ADB 1 , X 2 = AEB* 
where A, B are 2 x n matrices and D, E are n x n diagonal matrices. 
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Proof. The first frontal slice X\ has the form 



h u i L i 

t 2 o 1 c x 



* u 2 c l 



i J 



Z^i=l /1 l» c l ^il Z^i=l /1 l« c l 

E n A 



(i) 



E 

<=i 



A 2i cf S. 



>'2 



= AC X B\ 



„(i) 



,(2) 
'1 ' 



(n) 
1 



where Ci is the n x n diagonal matrix whose diagonal entries c\ ' , c 
come from row 1 of C . Similarly, for the second frontal slice we have X2 = AC 2 B f , 
where C2 is the nxn diagonal matrix whose diagonal entries come from the second 
row of C. Conversely, if the two frontal slices X\ and X2 can be written as AC\B l 
and A C 2 B t where A and B are 2 x n matrices and C\ and C2 are nxn diagonal 
matrices, then X has the given decomposition. □ 

Definition 2.2. We call the 2x2x2 array X superdiagonal if it has one of these 
forms for a,/3 € C \ {0}: 



" a 





" 




' 


a 





" 




' 





13 ' 




' 


(3 


" 








/3 _ 


7 














7 


a 








7 


a 









Lemma 2.3. 8, p. 632] A superdiagonal array has rank 2. 

Proof. By applying permutations of the slices, we may assume that X has the first 
form. It is then clear that the array has rank < 2 since 



" a 










a 




1 




1 























p 












(8) 





+ 






I 


<8> 


1 



To find the general form of an array of rank 1 according to Lemma 12.11 we set 

bi 
62 



.4 



«i 

«2 



B 



D=[d] 



E 



We obtain 

Xi = ADB 1 = 



a\db\ 
a2db\ 



a±db2 
a 2 db 2 



X, = AEB t = 



a\eb\ 
a 2 eb 1 



a\eb 2 
a 2 eb 2 



or more simply X\ = d(AB r ) and X2 = e(AB t ). Thus Xi and X2 are scalar 
multiples of the same matrix of rank 1. This does not hold for a superdiagonal 
array, which therefore has rank > 2. □ 

Lemma 2.4. [8j p. 632] Let X be a nonzero 2x2x2 array which is not super- 
diagonal. Then X has rank 1 if and only if all six of its slices are singular. 

Proof. (=>) We show that if X has a non-singular slice, then its rank is > 2. By 
permuting the directions, we may assume that a frontal slice is non-singular. By 
permuting the frontal slices, we may assume that X\ is non-singular. If the rank 
of X is 1 then as in the proof of Lemma |2~31 we have Xx = d(a ® b) where a and b 
are nonzero vectors in C 2 ; but this matrix is clearly singular. 

(<=) We show that if all six slices are singular then X has rank 1. 

Case 1: Some slice is zero; by permuting the directions and slices we may assume 
that X\ — 0. Since X2 is nonzero and singular we have X2 = a (gib for some nonzero 
vectors a, b G C 2 . But then X = a®b®ei where ei = [0, 1]*. 

Case 2: No slice is zero. Since X\ is nonzero and singular, we have X\ = a®b 
where a = [01,02]* and b = [61,62]' are nonzero vectors. By transposing the 
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vertical slices of X if necessary, we may assume that the first column of X\ is 
nonzero. Equivalently, b = [1, A]' for some A £ C; thus X\ = [a|Aa]. 

Subcase 2(a): A = 0. Since the first vertical slice is singular, X = [a, 0|/ia, d] for 
some \i £ C and some d; we have d ^ since the second vertical slice is nonzero. 
If /i ^ then since X2 is singular, there is v E C \ {0} such that X = [a, 0|/ia, va]. 
In this case, since the horizontal slices are nonzero, we have a\ ^ 0, 02 ^ 0. Since 
the horizontal slices are singular, it follows that // = 0, v = 0. But then the second 
frontal slice is zero, giving a contradiction. If \i = then X = [a, 0|0,d]. In this 
case, since the horizontal slices are nonzero and singular, X must be a superdiagonal 
array, again giving a contradiction. 

Subcase 2(b): A ^ 0. We have X — [a, Aa|/xa, d]. But a ^ and the second 
vertical slice is singular, so d = for some vgC, giving X = [a, Aa|/xa, va\. Since 
either ai ^ or 82 ^ (or both), singularity of the horizontal slices implies that 
v = Xfi. Then X = [a, Aa|/ia, Xfia] = [01,02]' ® [1, A]' <E> [1,A*]' has rank 1. □ 

Remark 2.5. We now have a partial algorithm for computing the rank of X. If 
X is the zero array then X has rank 0. If X is a superdiagonal array then X has 
rank 2. If X is nonzero and not superdiagonal, and all of its slices are singular, 
then X has rank 1. It remains to consider an array X with a non-singular slice; by 
permuting the directions and the slices, we may assume that X\ is non-singular. 

Lemma 2.6. [8j p. 632-633] The rank of a 2 x 2 x 2 array X is at most 3. 

Proof. It remains to prove that if the first frontal slice X\ is non-singular, then the 
rank is at most 3. We construct an explicit decomposition with n < 3. We write 



X21 



X12 
X22 



Y2 — X2X X 



2/21 



2/12 
2/22 



Consider the following matrices: 



A = 



D = 



1 y 12 

1 2/21 

10 0" 

1 





B = 



E = 



X12 



X21 
X22 



2/11 - 2/12 





£11 + X21 

X\2 + 2^22 


2/22 - 2/21 





= X{ 



We then verify by direct calculation that 



ADB 1 



AEB* 



2/12 

1 2/21 

2/12 

1 2/21 



1 
1 


2/11 - 2/12 





1 














1 


x x 




x u 




1 


1 













' 




' 1 





2 — 


2/21 










1 







1 




1 


1 



X\ — Y2X1 — X2 



We now apply Lemma 12.11 to complete the proof. 



□ 



Remark 2.7. Lemmas 12.41 and 12.61 imply that if X has a non-singular slice then 
its rank is either 2 or 3. It remains to distinguish these two cases. As before, up to 
permuting the directions and the slices, we may assume that X\ is non-singular. 
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Definition 2.8. For a 2 x 2 x 2 array X, Cayley's hyperdeterminant is the 

following homogeneous polynomial of degree 4 in the entries Xijk ■ 

A/-vn_2 2 _L 2 2 _L 2 2 _l_ 2 2 

L\(JL ) — XinX 2 22 T a: 112- z '221 "+" • E 121 3; 212 + a '122 a '211 

— 2(a;iiiXii22;221 :c 222 + 2:111X121X212X222 + 2:iii2:i 2 22;21l2:222 

+ 2:1122:121X2122:221 + 2:112X1222:211X221 + X121X122X211X212) 

+ 4(x m Xi22X 2 12X221 + Xii 2 Xi2lX21lX 2 2 2 ) ■ 

Theorem 2.9. [8l p. 633-634] Let Xbea2x2x2 array whose first frontal slice 
X\ is non-singular. If X2 is a scalar multiple of X\ , then X has rank 2. If X2 is 
not a scalar multiple of X±, then (a) if A(X) ^ then X has rank 2, and (b) if 
A(X) = then X has rank 3. 

Proof. First, assume that X 2 = XXi for some A £ C. Since X\ is non-singular, it 
has rank 2, and hence X ± — ® b^ + a^ 2 ' ® b^ 2 ). Writing c = [1, A]* then we 
see that X has rank 2: X = X\ ® c = a (1) ® b (1) ® c + a (2) ® b (2) ® c. Second, 
assume that X2 is not a scalar multiple of X\ . We will find a necessary condition 
for X to have rank 2. We apply Lemma 1 2 . 1 1 with n = 2 and write 

A = [ a« a( 2 ) ] , B = [ b« b< 2 ) ] , D = 



" di 





, E = 


ei 








d 2 





e2 



But X x = ADB 1 , X 2 = AEB 1 gives X x = diaib^ + d 2 a 2 b 2 , X 2 = eia x bf + e 2 a 2 b 2 . 
Since X\ is non-singular, it has rank 2, and so d\ ^ 0, c? 2 7^ 0. Since X2 is not 
a scalar multiple of X\, it follows that E is not a scalar multiple of D. Hence 
d\e2 — d 2 ei ^ 0, and so X 2 — d± e\X\, X 2 — d 2 e 2-Xi are distinct. We calculate 



X 2 - d^ 1 e 1 Xi = eiaib' + e 2 a 2 b 2 - d^ l e x (diaib* + d 2 a 2 b 2 ) 
= eiaib* + e 2 a 2 b 2 - e^b* - d 1 " 1 d2eia 2 b| = d^ 1 {die 2 - G? 2 ei)a 2 b 2 , 

X 2 - d~ 2 1 e 2 Xi = eiaib' + e 2 a 2 b 2 - d^ 1 e 2 (diaib* + d 2 a 2 b 2 ) 

= eiaib* + e 2 a 2 b 2 - dic^^aib* - e 2 a 2 b 2 = —d^ 1 (d\e2 - (fcejjaib*. 

It follows that these two matrices are singular. Hence the quadratic polynomial 
det(X 2 — AXi) has two distinct roots, but this determinant is 

(x m X 2 21 - Xi2lX 2 ll)A 2 - (x m X 22 2 + Xii 2 X 22 l - Xi 2 lX 2 12 ~ Xi 22 X 2 ll)A 
+ (X112X 222 - Xi2 2 X 2 12), 

and the discriminant is A(X). Thus if X has rank 2 then A(X) 7^ 0. 

Conversely, suppose that A{X) ^ 0. Then det(X 2 — AXi) has two distinct roots, 
say Ai, A2. We have two nonzero singular matrices X2 — Ai-Xj., X2 — Aa-Xj.. These 
matrices both have rank 1, and so we can write 



(Ai-A 2 )- 1 (X 2 -A 2 Xi) 



UlV*!, 



-(A 1 -A 2 )- 1 (X 2 -AiXi) 



u 2 v 2 . 



Then we have X\ = Uivf + u 2 v| and X2 = AiUiv^ + A 2 U2V 2 , which imply that 
X = ui®vi<g)[l, Ai]* + u 2 ®v 2 (8)[l, A 2 ]'. Thus if A(X) ^ then X has rank 2. □ 

Example 2.10. Consider these arrays, where X is the limit as a — > of Y(a): 



X = 



' 1 








1 " 





1 









Y(a) = 



' 1 








1 " 





1 


a 2 
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Clearly X\ is non-singular, and X 2 is not a scalar multiple of X\. But A(X) = 0, 
and so by Theorem 12.91 the rank of X is 3. For Y(a), the first frontal slice is 
non-singular and the second frontal slice is not a scalar multiple of the first, but 
A(Y(a)) = 4a 2 which is nonzero for a ^ 0. Hence if a ^ then Y(a) has rank 2. 
Thus X is the limit of arrays of rank 2, and so the border rank of X is 2. 

It follows from Ja'ja' [H Lemma 3.1] that an array [JIX2] has rank 2 if and 
only if X 2 is similar to a diagonal matrix. The same paper [4J Theorem 3.2] implies 
that if X 2 is the companion matrix of a quadratic polynomial f(t) then [/IX2] 
has rank 2 if and only if f(t) has two distinct roots; otherwise, it has rank 3. In 
our example, X2 is the companion matrix of f(t) = t 2 , so [ / | X2] has rank 3. This 
example is the case n = 2 of the pair of bilinear forms in the proof of [4j Theorem 
3.5]. A result of von zur Gathen [9] Theorem 4] implies that the maximal bilinear 
complexity of two 2x2 matrices over any field is at least 3. 

3. Some lemmas on 3 x 3 x 2 and 3x3x3 arrays 
Let the 3x3x2 array over C have frontal slices A and B: 



[A\B] 



Ja'Ja' [H Corollary 3.4.1] has shown that the rank of a p x p x 2 array is at most 
[3p/2j . We give an elementary proof of this result in the case p = 3. 

Lemma 3.1. The rank of a 3 x 3 x 2 array is at most 4- 

Proof. The maximum rank of a 3 x 3 matrix is 3. If both A and B have rank < 2, 
then it is straightforward to express [A\B] as a sum of < 4 simple tensors. We have 

A = a« ® b« + a< 2 ) ® b< a > , B = a.^ ® + a<*> ® b<*> , 



an 


a 12 


ai3 


foil 


''12 


&13 


an 


«22 


023 


621 


''22 


^23 


031 


"32 


033 


&31 


&32 


&33 



and hence 



= a^ ® bW ® ei + a< 2 ) ® b< 2 > ® ei + a ( 



(3) «?, b (3) ® e 2 + a (4) ® b (4) ® e 2 . 

We now assume that both A and -B have rank > 2, and that either A 01 B has 
rank 3. Interchanging A and £? if necessary, we assume that A has rank 3, so 
that A is invertible. Left multiplication of A and B by A^ 1 (that is, applying a 
change of basis in the first direction) gives the array [I\C] where the second frontal 
slice C = A~ 1 B still has rank > 2. There exists an invertible matrix E such that 
J = E~ 1 CE is the Jordan canonical form of C. (Here we use the assumption that 
the base field is algebraically closed.) Clearly E~ 1 IE = /, so we act on [J|C] by 
E~ x along the first direction and by E along the second direction, to obtain [I\J], 
where the second frontal slice J still has rank > 2. It remains to show that any 
such array has rank < 4. There are three cases for the Jordan canonical form of a 
3x3 matrix J. Case 1: Three lxl Jordan blocks; J is a diagonal matrix: 



[I\J] = 



1 








di 











1 








d 2 











1 








d 3 



Then clearly the rank is < 3: 



[I\J] 



ei ® ei 



1 

di 



■ e 2 ® e 2 



1 

d 2 



e3 ® e 3 



1 
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Case 2: One 2x2 block and one lxl block: 



[I\J] 



di 1 
di 







d 2 



We have [I\J] = [I\D] + [0\F] where I? is a diagonal matrix and F is the matrix 
unit E\2. By the previous case, [I\D] has rank < 3, and clearly [0\F] has rank 1. 
Case 3: One 3x3 block: 



[I\J] 



di 





1 

di 






1 

di 



We add — di times the first frontal slice to the second frontal slice; that is, we 
change basis along the third direction by the matrix 



1 

-di 



We obtain this array: 



It remains to prove that this array has rank < 4. 
representation as a sum of four simple tensors: 



" 1 











h- 1 


" 





1 











1 








1 












We have the following explicit 



" 1 











1 


" 



















1 











1 






















1 
































1 








1 


" 




" 
























1 

2 








1 

2 





+ 





1 

2 


-1 





1 

2 


1 















































1 


-1 


+ 
















1 




" " 


1 

2 


® 


1 

















" 














" 








1 

















1 















" 






-1 " 






1 










2 


® 




1 






1 









" 1 " 




1 " 







-1 











" " 




" " 


1 







1 




1 



This completes the proof. 



□ 



Let the 3x3x3 array T over C have frontal slices A, B and C: 

an ai2 Oi3 hi h2 h3 en Ci 2 C13 
T = [A\B\C] = a 2 i a 22 a 23 hi 622 b 23 c 2 i c 22 c 23 

031 a 32 033 &31 ^32 &33 c 31 C 32 C33 

Lemma 3.2. Kruskal's One-Edge Lemma. If the array T has parallel slices 
D and E for which there exists a nonzero vector x such that Dx = Ex = or 
£>*x = E f x = 0, then rank(T) < 5. 
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Proof. Permuting the directions if necessary, we may assume that D and E are 
frontal slices. Permuting the frontal slices if necessary, we may assume that D and 
E are the first and second frontal slices A and B. Suppose that Ax = £?x = where 
x ^ 0. Let X be a 3 x 3 non-singular matrix which has x as its first column. (Extend 
the set {x} to a basis {x,y,z} of C 3 and let X = [x|y|z].) Acting onT= Ul-B|C] 
by X along the second direction gives [^4X|BX|CX], but Ax = Bx = 0, so 



[AX\BX\CX] = 






a 'l2 


a'i3 







b[ 3 


c'n 


c 12 





°22 


a 23 





b' 22 


b' 23 


c 21 


c 22 





fl 32 


°33 





b' 32 


b' 33 




c 32 



-13 
=23 



"33 



" 

















c'n 





" 




" 


a'i2 


a 13 





b'u 


b'xa 





c'12 


c[ 3 




















c 21 








+ 





a 22 


a 23 





b'22 


b'23 





c 22 


c 23 




















c 31 













a 32 


a 33 





b' 32 


b' 33 





C 32 


c 33 



The first term is a simple tensor, 



c'n 




1 







c'21 







® 





4i 









1 



and so it remains to prove that the second term has rank < 4. To write the second 
term as a sum of simple tensors it suffices to decompose this 3x2x3 array: 



a'12 


a 13 


K 2 


b'u 


c 12 


c' }3 ' 


a 22 


a 23 


b'22 


b'23 


C 22 


C 23 


°32 


a 33 


b' 32 


b' 33 


C 32 


c 33 



Transposing the second and third directions, we may consider the 3x3x2 array, 



a'12 


b[ 2 


c'l2 


a 'l3 


b'n 


c' }3 


a 22 


b'22 


c 22 


a 23 


b'23 


c 23 


a 32 


t> 3 2 


C 32 


a 33 


b'33 


c 33 



The claim now follows from Lemma 13.11 



If A* 



B x = 0, then we transpose the matrices A, B and C and use the 



analogous reasoning; this can also be expressed in terms of a transposition of the 
first two directions in the array T = [A|_B|C]. □ 

Lemma 3.3. KruskaVs Two-Edge Lemma. If the array T has frontal slices D 
and E for which there exist nonzero vectors x and y such that Z?x = y l D = and 
y*£x ^ 0, then rank(T) < 5. 

Proof. As before, we may assume that D and E are the first and second frontal 
slices A and B. Let x and y satisfy the conditions of the lemma. We choose vectors 
u 2 , u 3 , v 2 , v 3 such that U = [x|u 2 |u 3 ] and V = [y|v 2 |v 3 ] are nonsingular. Then 



V t AU 



V*BU 



and V l CU 



where a = y*i?x 7^ 0, but (3 can be 0, and * denotes unspecified elements (which 
are not necessarily equal). If (3 = then we add B to C to make (3 ~ a ^ 0. 
Equivalently, we change basis along the third direction in T by the matrix 

"l 0" 
1 
1 1 
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Since q / 0, we can construct a matrix X of rank 1 which has the same first row 
and first column as V t BU; explicitly, 





a 


a' 


a"' 




a 


a' 


a" 


V*BU = 


7 


* 


* 


, X = 


a 


a. 


2 a" 

a 




S 


* 


* 






t-ot 

a 


-a" 

a 



' 























" 





* 


* 





* 


* 





* 


* 







* 





* 


* 





* 





Similarly, we can construct a matrix Y of rank 1 which has the same first row and 
first column as V t CU. Then the two arrays [0|X|0] and [0|F|0] also have rank 1 as 
3x3x3 arrays; that is, they are simple tensors. We now see that 



V^AlBlCp - [0|X|0] - [o|y|o] = 



It remains to decompose a 2 x 2 x 2 array, and this requires at most three simple 
tensors according to the results of Section [2] □ 

4. Proof of Kruskal's theorem on 3 x 3 x 3 arrays 

Theorem 4.1. Every 3x3x3 array T = [A\B\C] over C has rank < 5. 

Proof. If C = then the problem reduces to considering a 3 x 3 x 2 array, which 
has rank < 4 by Lemma \'S. II We assume from now on that C / 0. Consider the 
3x3 matrix A — AC; its determinant is a nonconstant polynomial in A, which has a 
root over C. (Here again we use the assumption that the base field is algebraically 
closed.) Thus by subtracting a multiple of C from A, we may ensure that A 
is singular, and so rank(A) < 2. Equivalently, we change basis along the third 
direction in T by the matrix 

"1 -A 
1 
1 

The same considerations apply to B. We assume from now on that the first and 
second frontal slices of T both have rank < 2. 

Suppose that some frontal slice has rank < 1; up to permuting these slices, we 
may assume that rank(A) < 1. If rank(A) = 0, then A is the matrix, and we 
have a 3 x 3 x 2 array, which has rank < 4 by Lemma l3~Tl If rank(A) = 1, then the 
array [^4|0|0] has rank 1; subtracting this simple tensor from T leaves a 3 x 3 x 2 
array which has rank < 4, and so T has rank < 5. 

We may now assume that A and B have rank 2, and that C has rank 2 or 3. 

Case 1: A, B and C all have rank 2. It follows that there exist nonzero vectors 
Xi,X2,X3 and yi,y2,y3 (basis vectors for the right and left nullspaces) such that 

Ax! = 5x 2 = Cx 3 = 0, y\A = y\B = y\C = 0. 

Then for the 3x3 matrices X = [X1IX2IX3] and Y — [yi|y2|y3] we have 



(1) Y t AX = 







Y l BX = 



Y l CX = 



If the conditions of Lemma l3.3l are satisfied for any two frontal slices, then the proof 
is complete. Otherwise, it follows that 



(2) 



ytAxt - y*Sx 4 = y*C Xi = 0, for all i = 1, 2, 3. 
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Consider these three subcases: 

Subcase 1.1: Two columns of X are linearly dependent (that is, one column is a 
scalar multiple of another) . Then Lemma 13.21 completes the proof. 

Subcase 1.2: The matrix X has rank 2, but no two columns are linearly depen- 
dent. Then Xi and X2 are linearly independent, and so X3 = /3xi + 7x2 for some 
/3, 7 £ C \ {0}. We choose vectors u, V2, V3 such that the matrices U = [xi|x2|u] 
and V = [yi|v 2 |v 3 ] are invertible. Then for some 8 e C we have 



V AU = 





* * 
* * 



V t BU = 



0* 

* * 

* * 



v t cu = 



5* 

* * * 

* * * 



(The (1, 1) entries oiV t BU and V t CU are zero; otherwise Lemma l3~3"l would apply.) 
But CX3 = implies /3Cxi + 7CX2 = 0, and so the first two columns of V t CU are 
linearly dependent, implying 8 = 0. Hence the first three rows of V t AU, V t BU 
and V t CU are linearly dependent. We subtract the simple tensor in which the 
first horizontal slice is the same as that of V*[.A|.B|C]?7 and the second and third 
horizontal slices are zero. There remains an array in which the first horizontal 
slice is zero, and the second and third horizontal slices are the same as those of 
V L4 1 £? I C]L/. But the rank of this 2x3x3 array is at most 4 by Lemma |3~T1 

Subcase 1.3: The matrix X has rank 3. If Y has rank < 2, then we replace 
each frontal slice A, B, C by its transpose (equivalcntly, we interchange the first 
two directions of T), and then we may apply one of the previous subcases. So we 
assume that Y has rank 3. Combining ([!]) and gives three matrices of rank 2: 



Y AX 





0^ 
a 



Y l BX 



8 

7 



Y l CX 



c 

e 




If we transpose the first two columns of X (that is, interchange the first two vertical 
slices of T) then we obtain 



Y AX = 



0' 

0/3 
a 



Y l BX = 



8 

7 



Y l CX = 



C 0' 

e 




We subtract from F*[t4.|.B|C]X the following sum of three simple tensors: 


















" 











































We obtain the following array: 









s 








" 




" 

















c 





" 








-7 











+ 



































-7 











































" 























" 


(3) 








p 








7 





e 










p 


p 





7 


7 












EVERY 3x3x3 ARRAY OVER C HAS RANK < 5 
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The three frontal slices are linear combinations of these two matrices of rank 1: 



"0 





0" 




"0 





0" 





1 


1 







1 








1 


1 














Therefore (J3j> is the sum of two simple tensors: 



" 























" 




" 























" 





p 


p 





7 


7 











+ 





-p 








-7 








e 








p 


p 





7 


7 









































We now have a decomposition of the original 3x3x3 array T into a sum of at 
most 5 simple tensors. 

Case 2: A and B have rank 2 but C has rank 3. 

Subcase 2.1: There exist a, (3 € C such that aA + (3B + C has rank 2. This 
corresponds to changing basis in T along the third direction by the matrix 

"1 0" 
1 

a & 1 

Then we are back in Case 1. Such scalars may not exist; a simple example is 



A = B 



C 



Subcase 2.2: The matrix a A + f3B + C has rank 3 for all a, (3 € 
nonzero vectors xi , X2 , X3 and yi , y2 , y3 such that 



There exist 



Ax 1= 5x2 = 0, Cx 3 = Ax 2 , y *A = y*B = 0, y\C = y\A. 



If we can apply Lemma 13.31 then we are done. So we may assume that Lemma [ 
does not apply, and hence we must have 

y\A Xl = y\B Xl = y\C Xl = 0, y|Ax 2 = y^x 2 = y^Cx 2 = 0. 

We write X = [xi|x 2 |x 3 ] and Y = [yi|y 2 |y3]- 

Subcase 2.2.1: We have linear dependence of xi and X2, or of yi and y2, or 
both. Then the result follows from Lemma 13721 

Subcase 2.2.2: We have linear independence of Xi and X2, and of yi and y2- 
Then both matrices X and Y have rank > 2. 

Assume X has rank 2. Then X3 = 7x1 + &X2 for some 7, 5 G C. There exist 
nonzero vectors u, v such that U = [xi|x2|u], V = [yi|y2|v] both have rank 3. 
Then using the previous equations we have 



V f AU = 



V f BU = 



V l CU = 



Since B has rank 2, it follows that e 7^ and C 7^ 0. We have 

y*Ax 2 = ^'(7x3 = 7^(7x1 + <5x 2 ) = 7^*Cxi + (5^*Cx2, 

and so the second column of V t AU is a linear combination of the first two columns 
of V t CU . Since X3 ^ 0, it follows that 7 and S are not both 0, and so rj — or 
6 = (or both). In either case, adding a multiple of B to C (that is, changing basis 
along the third direction), and applying the same change of basis matrices V* and 
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U along the first and second directions, gives an array in which the third frontal 
slice has rank 2. This contradicts the assumption that aA + f3B + C has rank 3. 

Assume X has rank 3. If Y has rank 2, then we interchange the first and second 
directions of the array, which amounts to applying the usual matrix transpose to 
the frontal slices A, B, C. Equivalently, we interchange X and Y, which reduces to 
the previous paragraph. So we may assume that Y also has rank 3. 

Using the previous equations, together with 



y 2 Ax 3 = y 3 Cx 3 = y 3 Ax 2 , 



we obtain 



Using the previous equations, we obtain 





"0 








Y l AX = 








7 







7 


6 


we obtain 










"0 





c 


Y l BX = 













c 





»?. 



Using the previous equations, together with 





= 0, 


yiCx 3 


= y\Ax 2 


= 0, 


y 2 C x 2 


-0, 


y 2 Cx 3 


= y\Ax 2 


= 0, 




= y* Axi = 0, 


y\Cx 2 


= y\Ax 2 


= 0, 



we obtain 



Y l CX 



If S ^ (respectively 77 7^ 0) then we add a multiple of A (respectively B) to C to 
eliminate 7 and obtain an array for which Y l CX has rank 2; but this contradicts 
the assumption that a A + (3B + C has rank 3. So we may assume that S = 77 = 0: 



Y AX 



Y l BX = 



Y l CX 



Interchanging the first and second vertical slices of T = \A\B\C\, and applying the 
same transformations, amounts to interchanging the first and second columns in 
each of the above matrices. We now have this array: 



" 














C 


A 





" 








7 














K 





. 7 











e 











7 . 



But A, k, 7 are all nonzero by our assumption that the third frontal slice has rank 3. 
We scale the first, second and third horizontal slices by 1/A, 1/k, I/7 respectively: 





j/k 

1 



C/A 

e/7 



1 
1 
1 



EVERY 3x3x3 ARRAY OVER C HAS RANK < 5 
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From this array we subtract the following array of rank 2, where the bars denote 
complex conjugates: 



and obtain 











































7/k 







- 





















1 








-C/A 

























" 




" " 






7/k_ " 




" " 










1 " 




" 1 


1 


eg) 





® 




-e/7 


+ 







X> 









-CM 







1 











1 




















" 














C/A 


1 







" 























e/7 







1 











. 








CM 


e/7 















1 _ 





The second frontal slice (which we still denote by B) is now Hermitian, and so its 
Jordan canonical form J = E~ 1 BE is a diagonal matrix. Changing basis along the 
first and second directions by E~ x and E respectively, we obtain 



" 
















1 





" 














V 








1 




























1 



This array clearly has rank 3, and the proof is complete. □ 

5. Arrays over the field with two elements 

In this section we use computer algebra to classify the canonical forms of 3 x 3 x 3 
arrays X — [xijk] over the field F2 with two elements. We use the term tensor for 
such an array to avoid confusion with the data structures called arrays in Maple. 
The flattening of X is the row vector flat(X) = [xm, . . . , Xijk, ■ ■ ■ , X333], where 
the entries are in lex order by subscripts. Conversely, the unflattcning of such a 
row vector is the corresponding tensor. We encode X as the non-negative integer 
whose representation in base 2 is flat(X). Conversely, the decoding of an integer 
in the range 0, . . . , 2 27 — 1 is the corresponding tensor. The lex order on Battenings 
coincides with the natural order on integers. The minimal element of a set of tensors 
is defined in terms of this total order. We identify X with an element of F 2 <g)F 2 Cg>F 2 . 
The direct product of general linear groups GL 3 (F 2 ) x GL 3 (W 2 ) x GL 3 (F 2 ) acts on 
F 2 eg) F 2 eg) F 2 , and the canonical form of a tensor is the minimal element in its orbit 
under this group action. The finite group GL 3 (F 2 ) has order 168, and is generated 
by two elements: the cyclic permutation ei i-> e 2 , e 2 n> e 3 , e 3 ei, and the row 
operation ei n> ei + e 2 , e 2 M> e 2 , i-> e 3 . The group GL 3 (F 2 ) x GLs(F 2 ) x GLs(F 2 ) 
has order 4741632 and is generated by 6 elements. 

For a tensor X over F 2 , we use the spinning algorithm to compute its orbit. In 
the following pseudocode, O is the current value of the orbit, £ contains the new 
elements computed during the previous iteration, and Af contains the new elements 
computed during the current iteration: 

(1) 0^9;C^{X} 

(2) while £ ^ do: 

(a) O^OUC 

(b) TV <- 0; for Y £ C do for M G Q do: M <- N U {M ■ Y} 

(c) C^M\0 
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(3) return O 

We first create a large Maple array, called orbitarray, with 2 27 — 1 entries. The 
indices of orbitarray correspond to nonzero tensors: for an index i we first decode 
i by writing it as a binary numeral of 27 bits (adding leading Os if necessary), and 
then unfiatten this binary numeral to obtain the corresponding tensor. To start, 
every entry of orbitarray is set to 0. We then perform the following iteration: 

(1) lu <- 0, i <- 

(2) while i < 2 27 -l do: 

(a) ii-i + l 

(b) if orbitarray[i] = then 

(i) uj «- uj + 1 

(ii) f indorbit[i] 

Procedure findorbit takes the index i, decodes and unflattens it to the corre- 
sponding tensor X, uses the spinning algorithm to generate the orbit 0{X), and 
sets the corresponding entries of orbitarray to the orbit index u>. Upon termi- 
nation, uj equals the total number of orbits for the group action, and orbitarray 
represents the function which assigns to each tensor the index number of its orbit. 
The natural order of the index numbers of the orbits agrees with the lex order on 
the minimal elements in the orbits (the canonical forms of the tensors). 

The next step is to compute the ranks of the orbits. We create another Maple 
array, called linkarray, of the same size as orbitarray. We use the data from 
orbitarray to set entry i of linkarray (representing the tensor X) equal to the 
index j of the next tensor in lex order in the orbit containing X. We then create 
another Maple array of the same size, called rankarray, and initialize every entry 
to 0. We generate all simple tensors (tensor products of nonzero vectors) and set the 
corresponding entries of rankarray to 1. Each index i for which rankarray[i] = 1 
represents the encoding of a tensor of rank 1. Let E denote the minimal tensor of 
rank 1: its flattening is [0, . . . , 0, 1]. We then perform the following iteration: 

(1) oldrank 0, finished «— false 

(2) While not finished do: 

(a) oldrank <— oldrank + 1, finished <— true 

(b) For each index i for which rankarray[i] = oldrank, do: 

(i) Let X be the unflattening of the decoding of i. 

(ii) Set Y <— X + E: this amounts to changing the rightmost bit of 
the flattening of X from to 1 or from 1 to 0. 

(iii) Let j be the encoding of the flattening of Y. Thus j = i + 1 if i 
is even, and j = i — 1 if i is odd. 

(iv) If rankarray[j] = 0, then Y has rank oldrank+ 1. In this case: 

• Use linkarray to store oldrank + 1 in every entry of 
rankarray corresponding to the tensors in the orbit of Y. 

• finished <— false 

The iteration terminates when every entry of rankarray contains a positive integer, 
which is the rank of the corresponding (nonzero) tensor. 

To reduce the number of orbits, we consider the larger group 

G = (GL 3 (F 2 ) x GL 3 (¥ 2 ) x GL 3 (F 2 )) x S 3 , 

where the symmetric group S3 permutes the three directions. We first compute 
the small orbits obtained by the action of GLs(F 2 ) x GLs(F 2 ) x GL 3 (F 2 ) and then 



EVERY 3x3x3 ARRAY OVER C HAS RANK < 5 
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apply the permutations to determine which small orbits combine to make a single 
large orbit. Given the canonical form X of a small orbit O with index number 
i, we apply the elements of S3 to obtain tensors X% = X, . . . ,Xq. We then use 
the Maple arrays, which we have already computed, to find the index numbers 
i\ = i, . . . , iq of the small orbits containing these tensors. We conclude that the 
union C\ U ■ • • U 0; 6 is a large orbit for the action of G. The canonical form for 
this large orbit is the smallest (in lex order) of the canonical forms of Oi 1 , . . . , O l& . 
There are 115 (nonzero) small orbits and 55 (nonzero) large orbits: 



rank 





1 


2 


3 


4 


5 


6 


# small 


1 


1 


4 


18 


44 


45 


3 


# large 


1 


1 


2 


8 


18 


23 


3 


# tensors 


1 


343 


43218 


2372286 


47506872 


83670048 


624960 


percent 


0.0000 


0.0003 


0.0322 


1.7675 


35.3954 


62.3390 


0.4656 



For the large orbit sizes and canonical forms, see Table [TJ This computation took 
just under 282 minutes with Maple 16 on a Lenovo ThinkCentre M91p Tower 
7052A8U i7-2600 CPU (Quad Core 3.40/3.80GHz) using Windows 7 Professional 
64-bit with 16 gigabytes of RAM. 

For similar results for other tensor formats over F2 , see [TJ [2] . 
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II 
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rank 


size 








canonical torm 
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i 
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l 




7 
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3 
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i 
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i—i i—i 
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10 
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11 
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790272 
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... 1 ... . 
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148176 
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l 








1 
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444528 
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....1.1. 


i 
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i 
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... 1 ... . 
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l 


l 


34 


5 


592704 


.... 1 
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l 
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.... 1 
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l 
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36 


5 
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.... 1 
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l 
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l 
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l 
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.... 1 
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Table 1 . Large orbits of 3 x 3 x 3 tensors over F 2 



